Generic Metadata Handling in Scientific Data Life Cycles
- Project Research
- 1-5 Chapters
- Abstract : Available
- Table of Content: Available
- Reference Style: APA
- Recommended for : Student Researchers
- NGN 5000
Introduction
This chapter introduces the dissertation by describing its context, the identified challenges, how the chosen challenge was met, the achieved impact, relevant publications, and how the thesis is structured. 1.1 Context In science data is the essential focal point in todays computational and quantitative approaches to scientific knowledge gain. Computational simulations enable far reaching explorations of modeled realities while quantitative methods gather data to improve the understanding of observed phenomena. These methods are increasingly viable only via high-end storage and large-scale High Performance Computing resources with individual requirements dramatically rising. Data throughputs involve gigabytes per second continuously, volumes are of petabyte magnitude, continuous files per second rates are in the double-digit range, and a vast universe of complex data representations exists. The great potential of such data is evident by the current trend of Big Data in science that aims at large-scale information extraction to foster scientific discoveries. This is fundamentally enabled by intelligently handling data and by combining a large variety of information technology methods to so-called data life cycles. In principle, these consist of data sources, systems to manage data as well as compute resources, methods for access rights management, utilization interfaces and data sinks. Scientists are naturally focused on their particular research. Thus, metadata is an essential step forward in the efficiency of use as it enables managing data based on its content instead of location. Via specific data life cycles scientists are freed from the necessity to extensively deal with IT infrastructures while still utilizing them to drive their research by handling their extensive data and computing demands. In this complex technological environment, a plethora of significant challenges presents itself that hinders the advancement of the state-of-the-art in data-driven knowledge gain. 1.2 Challenges Vital challenges in managing data life cycles are manifold. Federated authentication and authorization infrastructures need to be integrated while being mindful of the overall resilience of increasingly complex data life cycles. The increasing numbers of files and data amounts need to be managed by Big Data systems. These in turn need to be efficiently integrated with High Performance Computing resources for analysis which signifies the need for advanced interoperability. Besides automated pre- and postprocessing, the user-friendly creation, and execution of workflows to encapsulate complex analysis procedures need to be supported. Integrated scientific environments need to be provided that hide the underlying complexity while enabling that use. Essential is also the building of trust that an infrastructure delivers 6 1. INTRODUCTION what it promises. Closely connected is moving from a fixed-term build up phase to a sustainable operation phase. As these goals are partly opposing to each other, a effective balance between them needs to be developed for each data life cycle. The dissertation focuses on the major challenge of the organization of large numbers of files in the million range using information about data, so-called metadata. Currently, solutions are often either use case specific or lacking completely, thus, preventing easy access and re-use. Without metadata, users have to remember where an individual file is located. With a large number of files this is inefficient if not impossible. This especially holds true for Big Data use cases with a large number of files with complex content and stored in distributed locations. Currently, significant efforts need to be made to implement even narrowly applicable and pragmatic metadata handling solutions for every new scientific experiment.
Related Project Materials
Optimization of Wireless Network Coverage for Online Learning in Secondary Schools in Jalingo Local Government Area, Taraba State
Background of the Study
Wireless network coverage is a critical component of online learning infrastructure in secondary sc...
An Appraisal of Burn Wound Care Management Among Nurses in Taraba State Healthcare Facilities
Background of the Study
Burn injuries are one of the leading causes of morbidity and mortality worldw...
THE ROLE OF A BUSINESS PLAN IN THE SUCCESS OF AN ENTERPRISE
ABSTRACT
This study was carried out to examine the land availability challenges and mismanagement ...
An Appraisal of Nurses’ Knowledge and Practices in Managing Peripartum Cardiomyopathy in Bauchi State
Background of the Study
Peripartum cardiomyopathy (PPCM) is a form of heart failure that occurs during the last month of pregnancy or wit...
A CRITICAL ANALYSIS ON THE IMPACT OF THE CONCEPT OF IJBAR ON THE PRACTICE OF CHILD MARRIAGE UNDER ISLAMIC LAW
ABSTRACT
This study critically analyzes the impact of the concept of ijbar on the practice of child marriage under Islamic law. While chi...
Design of AI-Based Automated Course Material Summarization Models in Modibbo Adama University, Yola, Adamawa State
Background of the Study
Course material summarization is a critical task in education, as it helps students digest large vo...
The Role of Advertising in Supporting Non-Governmental Organizations (NGOs) in Kanke LGA, Plateau State
Background of the Study
Non-Governmental Organizations (NGOs) play a significant role in addressing socio-economic challeng...
An Evaluation of the Role of Religious Leaders in Promoting Political Participation in Birnin Kebbi LGA, Kebbi State: A Case Study of Election Sermons
Chapter One: Introduction
1.1 Background of the Study...
A CRITICAL ANALYSIS OF THE ROLE OF MULTINATIONAL COMPANIES IN DEVELOPING COUNTRIES
ABSTRACT
The main objective of this study was to look, at international business management and assess...
The Impact of Nurses' Knowledge of Cardiopulmonary Resuscitation (CPR) on Emergency Care Outcomes in Kano State
Background of the Study
Cardiopulmonary resuscitation (CPR) is a life-saving technique used in emergencies such as cardiac arrest, drowni...
